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Defective images within this document are accurate representations of the 
original documents submitted by the applicant. 

Defects in the images may include (but are not limited to): 

• BLACK BORDERS 

• TEXT CUT OFF AT TOP, BOTTOM OR SIDES 

• FADED TEXT 

• ILLEGIBLE TEXT 

• SKEWED/SLANTED IMAGES 

• COLORED PHOTOS 

• BLACK OR VERY BLACK AND WHITE DARK PHOTOS 

• GRAY SCALE DOCUMENTS 
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As rescanning documents will not correct images, 
please do not report the images to the 
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(54) Browser for documents with annotations 

(57) The present Invention provides a browser tor 
viewing documents in Postscript or a similar type for* 
mat, with added functionality The system of the present 
invention creates information for additional material, 
such as bookmarks, annotations, and hyperlinks, based 
upon user inputs The information includes the position 
and content of the additional material, and the refer' 
ences to other additional material. The information is 
stored h the comments section of the document file or 
in a corresponding auxiliary file, which accompanies the 
document file. While a document is being view In a 
broutsef, the information Is used for manipulating and 
traversing the document The additional material Is pre- 
s anted on ihe display of the document and can be 
selected by the user. The user then reviews the added 
material and can use the hyperlinhs to move to other 
portions of the document, Users can add additional 
materia). Upon closing the document, all of the informa- 
tion ts stored far later retrieval. 
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Description 

Field of the Invention 

[0001] The present Invention relates to a computer- 
based system for viewing documents, in particular doc- 
uments in a PostScript format. Mote specifically, ft 
relates to a viewer which allows the addition of annota- 
tions to documents and hyperllnWng of annotations 
within these documents, 



Background of the li 



[0002] A variety of different formats can be used lor 
representing documents in a computer, Different stand- 
ards have developed which are used based upon the 
objectives for use of the document. 
[0003] in word-processing systems, documents are 
typically represented In ASCII codes with formatting 
codes. ASCII codes represent each character by a spe- 
cie dgrtal value. The formatting codes allow different 
type fonts, character fonts, and positions to be used. 
The word -processing program then generates the char- 
acters in trie appropriate* fonts and positions for display. 
Since each character is separately represented, char- 
acters can be easly changed, renewed, or added An 
ASCII-based far mat also alows simple searches tor 
characters or groups of characters, and can easily rep- 
resent pages. However, representing documents in an 
ASCII-based format has many drawtwijoks- For example 
drawings cannot be easily represented in an ASCII- 
based formal Typically, a word processor uses an 
embedded object that references a drawing that is 
stored elsewhere in a different format 

[0004] Graphical based formats address some of the 
deficiencies in an ASCII-based formats, but have addi- 
tional problems, in a typical graphical-based format, 
each page of a document is represented by bits for each 
light and dark space on the page. For example, a fax 
macHne generates a representation of a document 
which is merely the pixels which are the dark spaces on 
the page representing characters. Such a format how- 
ever, does ret allow searching or skipping pages. Also : 
most graphical formats do not easily grow or shrink 
since the characters can become dtetorted. 
[0005] Adobe, Inc. developed a graphical type repre- 
sentation called 'PostScript" which has become the pre- 
mier accepted page-description language In Postscript 
format, a graphical representation of a page is used that 
allows for magnification and shrinking. The PostScript 
format includes any material that ffts upon a printed 
page, including figures and drawings. Most documents 
are converted to PostScript format for printing. Most 
documents are oorwerted to PostScript format for print- 
ing. Most on-line documents, such as documents on 
CD-ROMs, the internet or the world Wide Web, are 
represented In Postscript format. However, there are sill 
some signrtcarrt deficiencies wrth files in PostScript tor- 
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mat Typically, a document viewer simply displays the 
document page as h would appear if primed. Since 
pages m the fie are stored seojuentialy, the viewer must 
go through each page to arrive at a de&red page. For 
long documents, mis can be extremely tedious. Gener- 
ally, jumping around m a document is not feastte. Also, 
information cannot easily be added to the document tor 
future reference or for review by others. 
[0006] When one views a paper document, he or she 
wiQ often scan through the pages, turn to other sections, 
or make notes on the documents or in the margins. 
These actions are not possible in a typical PostScript- 
type document tn order to move around in a graphical 
type document, a different format referred to as hyper- 
text has been used The Hypertext format allows posi- 
tioning a link to some otter element, erfrer another 
object or fie, or another place in the f Be, with a specific 
position on a page To activate tfie link, the user selects 
the identified pesffion. For example, U.S. Patent No. 
5,367,621 cfsdoses a generalized link from a reference 
point In an orriine book to an arbitrary muffl media 
object. However, as disclosed in that patent, the links 
must be created by the author of the text when the book 
is crested. Arbftrary Inks cannot be added to an existing 
document. To do so would require entry of new codes 
representing the Pnte 

Summary of the Invention 

[0007] The foregoing deficiencies in existing docu- 
ment systems are overcome by the present Invention 
which includes a browser or viewer for documents, such 
as Postscript documents, with added functionalrry. The 
system of the present invention reads and displays 
PostScnpt-type documents It also allows the addition of 
bookmarks, annotations, and hyperlinks in order to 
more easily move around and add information to a Post- 
script document. The irrformation for the bookmarks, 
annotations, and hyperlinks are created by the browser 
of fits present invention. While the document is being 
viewed, the information and linte are used for manipu- 
lating and traversing frie document. The information is 
also stored in the comments section of the Postscript 
document so that they can be retrieved later without 
oompromlsing the existing functionality and portability of 
the document. The present invention can also be used 
with any page description format documents which 
include a comments section or auxliary fie, not just 
Postscr^rt documents. 

Brief Dgrarintinn of the Drawings 



[0006] 

Fig. 1 



is a block diagram llustrarjng hardware of a 
computer system which could be used fai 
implementing the browser of the present 
invention. 
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Fig. 2 represents the data format for a PostScript 
document 

Rg. 3 frustrates a display for the present Invention. 

Fig. 4 is a flow diagram lo* operafon of the browser 
according to an embodiment of ttte present 
invention. 

[0009] The present invention relates to a viewer or 
browser that operates on a computer to view digfelly 
stored documents, particularly documents in PoslScrtpt 
formats. Rg. 1 illustrates hardware which could be used 
in inrplemerrting the present Invention. As illustrated in 
Fig. 1 , computer system 1 Includes central processing 
unit (CPU) 10. The CPU 1 0 can be any type d proces- 
sor, such as those used in general-purpose computers 
for executing instructions 

[001 0] A program memory 2i stores Instruction steps 
executed by the CPU 10 in order to read, display and 
modify documents. Trie documents are stored in the 
document rnernory 20. The program memory 21 and 
document memory 20 can be any type at memories 
including RAM. ROM. CD-ROM, or other digital storage 
medium. Although the pro-am memory 21 and docu- 
ment memory 20 are Illustrated as separate elements, 
they may also be different portions of the same memory 
structure. 

[0011] A display SO is connected to the CPU 10 in 
order to display the documents and other information to 
the user. A Keyboard 40 and mouse 41 are connected to 
the CPU 10 for the user to display the documents and 
operate the browser. Of course, other devices coi*d be 
used by the user in order to manipulate and display doc- 
uments 

[0012] An input device SOts connected to the CPU 10 
in order to input document data into the document mem- 
ory 20. The Input device 50 could include a modern tor 
connection to an external source such as the Internet 
or other device foi retrieving documents in the proper 
tor mar 

[0013] As illustrates In Fig 2, document data 70 tor a 
Postscript dooument includes two sections, a data sec* 
tion 80 and a comments section 90 The data section €0 
is divided into pages 31 *84, each section representing a 
srigie page of the document Ordinarly. when the doc- 
ument is displayed or printed, the Information for each 
page in the data section is retrieved and processed in 
order to display or print the document. The comments 
section 90 is of variable size and allows the addition of 
information unrelated to the actual display of the docu- 
ment in the present invention, annotation and hyperlink 
Information is stored in the comment section. Thus, the 
data section 80 is not affected and the document can be 
printed or displayed by amy viewer or browser. In the 
ordinary manner. Although a PostScript format is illus- 



trated, the present indention can operate with different 
formats. The document format must include a data sec- 
tion separated into pages and a cornment section or 
auxiliary f ile. The brwser operates in the same manner 
e in adding annotations and hyperlinks to the document 
regardless of the document format 

rj00i4] Rg. 3 represents a display lOOof a document 
according to the present tiwerrhon. The document in 
PostScript format can include text iiC and figures or 

to drawings 111. The text 1 10 and the drawings 1 1 1 are 
stored in the data section 60 of the document data. The 
browser of the present invention retrieves and displays 
this information for each page. Any known Postscript 
interpreter can be used for this function. The browser 

15 also allows the addition of annotation icons 120 at any 
location on the pag* Of ccuse : for other types of docu- 
ment fa mats, a corresponding, appropriate interpreter 
would be used. The annotation icon 120 includes a title 
122, a representation ol addttonal information or text 

so 121, and a representation of any hyperlinks 123 to other 
annotations, Annotations are reviewed and changed 
through a dialog box 130. The dialog box 130 indudes 
^>ace for the name 132 of the annotation, a hyperlink 
123 for the annotation, and the text 195 of the armota- 

25 Hon. The dialog box 1 30 also includes buttons for per- 
forming certain functions with respect to this annotation , 
When the user revises a name, hyperlink destination, or 
text of the annotation, the user can then select the 
update button ise, or cancel button 13? in order to 

so change or not change the annotation. The user may 
also select the remove button 133 In order to eliminate 
the annotation. The browser display also includes other 
areas for manipulating and viewing annotations In the 
document At the bottom of the screen, there are but- 

85 tons for mwing to the previous page 140 and next page 
141, A hypertext button 142 Is used for adding annota- 
tions or hyperinks. The user may select the page menu 
143 in order to move around in the document or select 
additional pages. The file menu 144 is used to open and 

40 close documents and exrt the system. 

rjoois] Fig. 4 Illustrates the flow for a program Instan- 
tiating the browser and allowing review of documents. 
At step 203, the data lor the Postscript document is read 
from the document memory 20. 

45 [0016] A step 200, the comments section of the docu- 
ment data is read from the document memory 20 In 
order to determine armorial Ions. The annotations are 
stored following delimiters cn the comments section of 
the postscript file. Table 1 Hiustrates storage of the 

CO annotation information in the comments section. Of 
course* the annotation information ooukJ be stored in 
any format which permits the information tor each anno- 
tation to be retrieved. 

55 

TABLE 1 

^BrowserAnrxrtation 0,01200500.072519 
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TABLE 1 (continued) 
%Brows€rAnnolationName marker 
%6rowserAnnotationText adst 
%6rawGerAnrxitationdEnd 
%Brows«rAn notation 4 0-1749380*176245 
%BrowserAnno4ationName label 
%Brow^rAnnotationlink 0 
%6fOws«rAnr>otationBacklinK 0 
%8row$erAnnotetionTexl This is an annotation 
with mtitipte 

%BrowserAnnatatioriText lines 
%&owserAnnotattonEnd 

[0017] The program the creates a link structure based 
upon the annoiatfon information (step 210). The first 
page is then selected (step 21 5K and ci splayed (step 
220). The pages are displayed in the same manner as 
any browser cfisplays a Postscript fie. The system the 
waits for an input from the user (step 225)* User may 
input information using the keyboard 40. mouse 4i , or 
other input device. The steps to cause action are simple 
as illustrated in Fig, 4. A1 step 230, a user selects the 
previous page by selecting the previous page button 
140 using the mouse. When the previous page ss 
selected, the page nurroer & adjusted (step 235) and 
the previous page is then displayed at step 220. Simi- 
larly, when Hie next page button 141 is selected (step 
240) the page number »s atfusted upwards by one (step 
245) and the next page is displayed in step 220. A Go To 
page feature (step 250) can be selected using the page 
menu. The user then inputs the page number (step 
255). That page number then becomes the current page 
(step 257), which is displayed at step 220. The user can 
view an annotation (step 260) by seiacbng an annota- 
tion icon. When the annotation icon is ejected, the 
annotation dialog box is displayed (step 265). When the 
user is done viewing the annotation, the user will sel ect 
the cancel button 137 {step 267). A user can go to the 
next inked annotation (step 270) by clicking on the 
annotation portion 123 of the annotation icon 120. As 
illustrated in Table 1, the hyperlink information includes 
the number of the linked annotation, which identifies the 
page and location on the page- The current page then 
becomes the target page of tie hyperlink and is dis- 
played in step 220. 

[001 fi] FinaJry, the user may edit or add annotations 
(steps 260-286) To modify an annotation the user 
would select the annotation-insertion icon, which wii 
cause tfaiog bo* 130 to be displayed- The user can 
then edt the name, hyperlink destination, or annotation 
text When the user selects the update button 136 the 
information Is stored with the linked data In order to 
maintain the new information. If the user selects the 



cancel button, then any changes are not made to the 
annotation. The user may also select the remove button 
138 which results in the name, hyperlink data and text 
being deleted from the link data. 

5 [0019] When the use* exits the browser or document 
(step 290) the Information In the finked data is then 
stored in ttte oomments section ol the document data 
stored in the document memory. By storing information 
In the comnento section, the data portion ol the docu- 

fo merit is not affected. The document can still be read, 
displayed and printed by other programs without the 
annotation information. 

[0020] Having now deserted a few embodiments of 
the invention, H should be apparent to those skilled in 

ie the art that the foregoing is merely ilusiratrve and not 
limiting, having been presented by way of example only. 
Numerous modifications and other embodiments are 
within the scope of one of ordinary skin In the art and 
are contemplated as falling wtthfn the scope of the 

20 invention as defined by the appended claims. 

Claims 

1* A system for viewing a document having a com- 
S6 merit data area comprising : 

a browser far reading document data and dfe- 
playing said document data; 

so annotation means for reading additional data in 

said comment data area associated with said 
document data; and 

annotation cf splay means for displaying the 
35 additional data with corresponding pages of 

said document data. 

2. The system of claim 1 > further comprising annota- 
tion creation means for creating additional data 
40 associated with said document derta. 

X The system of claim 1 , wherein said additional data 
includes a name, a location in said document data, 
and text. 

45 

4* The system ol clai m 1 . wherein sard annotation dis- 
play means displays said additional data as an icon 
at a specified location relative to display of said doc- 
ument data; and wherein said system further oom- 
50 prises annotation enlargement means for 
displaying said additional data as text when said 
Icon Is selected by a user. 

5. The system of claim 1 , wherein said additional data 
ss indudes a hyperlink to a second location in said 
document data; said system further comprising 
moving means tor moving to said second location 
so as to display said document data at said second 
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location. 

6l The system of claim 1 , further comprising : 

annotation storage means for storing said ado?- e 
ttonai data in said comment data area associ- 
ated with said document data. 

7. The system of claim 1 , wherein said document la In 
a PostScript format and wherein said comment to 
data area ts a commentf ield of said document 

& A method for viewing a document comprising the 
steps of: 

reading document data of said document; 
displaying portions of said document data; 

creating adcfticnal data associated with a I oca- so 
tion h said document data baaed upon a user 
input and 

storing said additional data in a comment data 
area of said document. 25 

9l The method of claim ft, futher comprising the step 
of reading said additional data In tie comment data 
area of said document. 

3d 

i Ol The method of claim 9, further comprising the step 
of cispiaying said additional data at said location 
associated with said document data, 

11, The method of claim 10, wherein said additional as 
data is displayed as an icon; 

the method further comprising the step of dis- 
playing said additional data as text when said 
icon is selected by a user. <# 

1 2. The method of claim e, wherein said additional data 
includes a second location associated with said 
doc unent data; 

45 

the method further comprising the step display- 
ing a portion of said document data associated 
with said second location when said associated 
data is selected by said user. 

eo 
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Change the fonts in this figure. Use the font to 
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